Papers with knowledge extraction
An automated medical scribe for documenting clinical encounters (N18-5)
Copied to clipboard
Gregory Finley, Erik Edwards, Amanda Robinson, Michael Brenndoerfer, Najmeh Sadoughi, James Fone, Nico Axtmann, Mark Miller, David Suendermann-Oeft
| Challenge: | a medical scribe is a clinical professional who charts patient–physician encounters in real time. |
| Approach: | They propose to use multiple speech and language technologies to create an automated medical scribe. |
| Outcome: | a medical scribe can be used as an alternative to human scribes or as an assistive tool for physicians . the system relies on multiple speech and language technologies, including speaker diarization, medical speech recognition, knowledge extraction, and natural language generation. |
A Korean Knowledge Extraction System for Enriching a KBox (C18-2)
Copied to clipboard
| Challenge: | Existing systems for knowledge extraction from natural language sentences are lacking for all languages. |
| Approach: | They propose a Korean knowledge extraction system and web interface for enriching a KBox knowledge base based on the Korean DBpedia. |
| Outcome: | The proposed system can extract factual knowledge from natural language sentences . the endpoint can be used to add knowledge to a KBox knowledge base anytime and anywhere . |
Relating Relations: Meta-Relation Extraction from Online Health Forum Posts (2021.eacl-srw)
Copied to clipboard
| Challenge: | Relation extraction is a key task in knowledge extraction, and is often defined as identifying relations that hold between entities in text. |
| Approach: | They propose to conceptualise relation extraction tasks for user-generated health texts and create a dataset and model for meta-relation extraction. |
| Outcome: | The proposed model will be able to extract meta-relations from user-generated health texts with tolerable cognitive load and a new dataset and annotation scheme with tolerance for annotations. |
Conceptualisation and Annotation of Drug Nonadherence Information for Knowledge Extraction from Patient-Generated Texts (D19-55)
Copied to clipboard
| Challenge: | a new approach to knowledge extraction (KE) is needed for the health domain. |
| Approach: | They propose an approach to extracting knowledge about antidepressant drug nonadherence from health forums. |
| Outcome: | The proposed approach can be used to extract knowledge about antidepressant drug nonadherence from health forums. |
Knowledge Extraction From Texts Based on Wikidata (2022.naacl-industry)
Copied to clipboard
| Challenge: | Existing knowledge extraction pipelines for English are not suitable for enterprise use. |
| Approach: | They propose a knowledge extraction pipeline for English which can be further used for building an entreprise-specific knowledge base. |
| Outcome: | The proposed pipeline can be used to build an entreprise-specific knowledge base. |
AdapterFusion: Non-Destructive Task Composition for Transfer Learning (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing methods for incorporating knowledge from multiple tasks suffer from catastrophic forgetting and difficulties in dataset balancing. |
| Approach: | They propose an algorithm that extracts and combine adapters in a knowledge composition step. |
| Outcome: | The proposed class outperforms traditional methods such as full fine-tuning and multi-task learning on 16 diverse NLU tasks. |
ATOM: AdapTive and OptiMized dynamic temporal knowledge graph construction using LLMs (2026.findings-eacl)
Copied to clipboard
| Challenge: | Unstructured data is expanding at an unprecedented rate, and static knowledge graphs are often overlooked due to their dynamic nature and lack of time-sensitive features. |
| Approach: | They propose a few-shot approach that builds and continuously updates Temporal Knowledge Graphs (TKGs) from unstructured texts. |
| Outcome: | Empirical results show that ATOM achieves 18% higher exhaustivity, 33% better stability, and over 90% latency reduction compared to baseline methods. |
Culture Cartography: Mapping the Landscape of Cultural Knowledge (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) can empower users to be more knowledgeable, productive, and creative, but their utility is often diminished for under-represented groups and cultures. |
| Approach: | They propose a methodology that operationalizes a mixed-initiative approach to finding culture-specific knowledge that is salient to in-group users but unknown to LLMs. |
| Outcome: | The proposed method improves the accuracy of LLMs on culturally-competent language models by 19.2%. |
Knowledge Extraction on Semi-Structured Content: Does It Remain Relevant for Question Answering in the Era of LLMs? (2026.eacl-long)
Copied to clipboard
Kai Sun, Yin Huang, Srishti Mehra, Mohammad Kachuee, Xilun Chen, Renjie Tao, Zhaojiang Lin, Andrea Jessee, Nirav Shah, Alex L Betty, Yue Liu, Anuj Kumar, Wen-tau Yih, Xin Luna Dong
| Challenge: | Existing literature on knowledge extraction for question answering questions whether it is still relevant for question answerrs. |
| Approach: | They extend an existing benchmark with knowledge extraction annotations and evaluate commercial and open-source LLMs of varying sizes. |
| Outcome: | The proposed model can achieve high QA accuracy, but can still benefit from knowledge extraction through augmentation with extracted triples and multi-task learning. |
Narrative Embedding: Re-Contextualization Through Attention (2021.emnlp-main)
Copied to clipboard
| Challenge: | a novel approach to narrative event representation uses attention to re-contextualize events across the whole story . a recent study shows that attention is used to attach event semantics to tokens . |
| Approach: | They propose an unsupervised approach to narrative event representation using attention to re-contextualize events across the whole story. |
| Outcome: | The proposed approach achieves state of the art performance on multiple choice and story cloze tasks. |
Event Detection with Neural Networks: A Rigorous Empirical Evaluation (D18-1)
Copied to clipboard
| Challenge: | Neural network models have been the most successful for event detection, but they ignore syntactic relationships in the text. |
| Approach: | They propose a GRU-based model that combines syntactic information along with temporal structure through an attention mechanism. |
| Outcome: | The proposed model is competitive with existing models on a ACE2005 dataset. |
A Unified Framework for N-ary Property Information Extraction in Materials Science (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a framework for extracting n-ary property information from materials science literature is proposed . the framework addresses the critical challenge of capturing complex relationships that span multiple sentences. |
| Approach: | They propose a framework for extracting n-ary property information from materials science literature . they propose three complementary approaches to capture complex relationships that span multiple sentences . |
| Outcome: | The proposed framework outperforms existing methods in n-ary property extraction tasks. |
TextMineX: Data, Evaluation Framework and Ontology-guided LLM Pipeline for Humanitarian Mine Action (2026.findings-eacl)
Copied to clipboard
| Challenge: | Humanitarian Mine Action (HMA) authorities publish large amount of life-saving operational knowledge, but much remains locked away in unstructured reports. |
| Approach: | They propose a dataset, evaluation framework and ontology-guided large language model pipeline for knowledge extraction from text in the HMA domain. |
| Outcome: | The proposed framework improves extraction accuracy by 44.2% and reduces hallucinations by 22.5% . the proposed framework can be used to analyze human-annotated triples and an LLM-as-Judge protocol . |
Knowledgeable or Educated Guess? Revisiting Language Models as Knowledge Bases (2021.acl-long)
Copied to clipboard
| Challenge: | Recent studies show that pre-trained masked language models can be factual knowledge bases. |
| Approach: | They conduct a rigorous study to explore the underlying predicting mechanisms of MLMs . they find that previous decent performance mainly owes to the biased prompts which overfit dataset artifacts a . |
| Outcome: | The proposed model improves on illustrative cases and external contexts . the results question the previous findings that MLMs can be reliable factual knowledge bases . |
DeModify: A Dataset for Analyzing Contextual Constraints on Modifier Deletion (L18-1)
Copied to clipboard
| Challenge: | a text fragment is discarded when it has a smaller context, causing it to acquire a new meaning or even become false. |
| Approach: | They build a dataset to study the effect of modifiers on the larger context . they focus on single-word modifiers, the smallest unit that can be considered disposable . |
| Outcome: | The proposed dataset aims to determine whether modifiers can be removed without undesirable consequences. |
CAGK: Collaborative Aspect Graph Enhanced Knowledge-based Recommendation (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing KG-based recommendations have low link rates, redundant knowledge in KG, and low ratings and negative aspect sentiment. |
| Approach: | They propose a model that integrates auxiliary information such as social networks, user or item attributes, images, contextual data, etc. |
| Outcome: | The proposed model improves on two widely used benchmark datasets, Amazon-book and Yelp2018. |
Lost in the Distance: Large Language Models Struggle to Capture Long-Distance Relational Knowledge (2025.findings-naacl)
Copied to clipboard
| Challenge: | Recent large language models have demonstrated impressive capabilities in handling long contexts . however, as context length increases, LLMs struggle more with filtering out irrelevant information . |
| Approach: | They propose to use unrelated sentences to capture relational knowledge over long contexts . they find that LLMs can handle edge noise with little impact, but can reason about distant relationships . |
| Outcome: | The proposed model can handle edge noise with little impact, but its ability to reason about distant relationships declines as the noise grows. |
Towards Alleviating the Object Bias in Prompt Tuning-based Factual Knowledge Extraction (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to optimize prompts for factual knowledge extraction are undesirable object bias. |
| Approach: | They propose a prompt tuning method that reduces object bias and improves factual knowledge extraction. |
| Outcome: | The proposed method reduces object bias and improves accuracy of factual knowledge extraction. |
GUI-explorer: Autonomous Exploration and Mining of Transition-aware Knowledge for GUI Agent (2025.acl-long)
Copied to clipboard
| Challenge: | GUI automation is a key challenge in dynamic environments. |
| Approach: | They propose a training-free GUI agent that integrates two mechanisms to explore trajectories in GUIs. |
| Outcome: | The proposed GUI-explorer shows significant improvements over existing agents. |
Diagram-Driven Course Questions Generation (2025.emnlp-main)
Copied to clipboard
Xinyu Zhang, Lingling Zhang, Yanrui Wu, Muye Huang, Wenjun Wu, Bo Li, Shaowei Wang, Basura Fernando, Jun Liu
| Challenge: | Visual Question Generation (VQG) research focuses on natural images while neglecting diagrams, a critical component of educational materials. |
| Approach: | They propose a diagram-driven course questions generation task to generate diagram-relevant questions for specific courses. |
| Outcome: | The proposed framework outperforms existing models on DiagramQG while maintaining strong generalizability across natural image datasets. |
BERTese: Learning to Speak to BERT (2021.eacl-main)
Copied to clipboard
| Challenge: | Recent work shows that pre-trained language models encode large amounts of world knowledge in their parameters. |
| Approach: | They propose a method for automatically rewriting queries into a paraphrase query called "BERTese" they add auxiliary loss functions that encourage the query to correspond to actual language tokens . |
| Outcome: | The proposed method outperforms baselines and provides some insight into the type of language that helps language models perform knowledge extraction. |
Knowledge Graph-Enhanced Large Language Models via Path Selection (2024.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have shown unprecedented performance in various real-world applications, but they are known to generate factually inaccurate outputs. |
| Approach: | They propose a framework to integrate external knowledge extracted from Knowledge Graphs (KGs) they propose to generate scores for knowledge paths with input texts via latent semantic matching. |
| Outcome: | Experiments on real-world datasets validate the effectiveness of a framework to extract knowledge from Knowledge Graphs (KGs) incorporating external knowledge has become a promising strategy to improve the factual accuracy of LLM-generated outputs. |
UniArk: Improving Generalisation and Consistency for Factual Knowledge Extraction through Debiasing (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing studies have investigated the potential of language models as knowledge bases and the existence of severe biases when extracting factual knowledge. |
| Approach: | They propose an adapter-based framework for generalised factual knowledge extraction using simple methods without introducing extra parameters. |
| Outcome: | The proposed framework improves the model’s out-of-domain generalisation and consistency under various prompts. |
Grounded Multimodal Procedural Entity Recognition for Procedural Documents: A New Dataset and Baseline (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods to extract procedural knowledge from documents focus on text-only settings, which is insufficient for entity disambiguation. |
| Approach: | They propose a model to detect the entity and the corresponding bounding box groundings in images. |
| Outcome: | The proposed model detects the entity and the corresponding bounding box groundings in image (i.e., visual entities) it is based on a dataset of a WikiHow 1 and EHow 2 document and the results are compared with existing models. |
TXtract: Taxonomy-Aware Knowledge Extraction for Thousands of Product Categories (2020.acl-main)
Copied to clipboard
| Challenge: | State-of-the-art methods for knowledge extraction are designed for a single category of product, but do not apply to real-life e-Commerce scenarios. |
| Approach: | They propose a taxonomy-aware knowledge extraction model that applies to thousands of categories organized in a hierarchical taxonomies. |
| Outcome: | The proposed model outperforms state-of-the-art methods on 4,000 categories in F1 and 15% across all categories. |
Query-Driven Multimodal GraphRAG: Dynamic Local Knowledge Graph Construction for Online Reasoning (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to build knowledge graphs with LLMs are constrained by static knowledge bases and ineffective multimodal data integration. |
| Approach: | They propose a Query-Driven Multimodal GraphRAG framework that dynamically constructs local knowledge graphs tailored to query semantics. |
| Outcome: | The proposed framework outperforms unsupervised competitors in cross-modal understanding of complex queries. |
KITAB-Bench: A Comprehensive Multi-Domain Benchmark for Arabic OCR and Document Understanding (2025.findings-acl)
Copied to clipboard
Ahmed Heakl, Muhammad Abdullah Sohail, Mukul Ranjan, Rania Elbadry, Ghazi Shazan Ahmad, Mohamed El-Geish, Omar Maher, Zhiqiang Shen, Fahad Shahbaz Khan, Salman Khan
| Challenge: | Optical Character Recognition (OCR) is a key component of document processing . Arabic text recognition has complex typographic and calligraphic features . |
| Approach: | They propose a comprehensive Arabic OCR benchmark that fills the gaps in evaluation systems. |
| Outcome: | The proposed benchmark outperforms existing models in Arabic by 60% in the character error rate . the best model achieves only 65% accuracy in PDF-to-Markdown conversion . |
Take Care of Your Prompt Bias! Investigating and Mitigating Prompt Bias in Factual Knowledge Extraction (2024.lrec-main)
Copied to clipboard
| Challenge: | Recent research shows that pre-trained language models suffer from “prompt bias” in factual knowledge extraction. |
| Approach: | They propose a representation-based approach to mitigate prompt bias during inference time by querying the model and removing it from its internal representations to generate debiased representations. |
| Outcome: | The proposed approach corrects the overfitted performance caused by prompt bias and significantly improves prompt retrieval capability. |
Decoupled Reasoning with Implicit Fact Tokens (DRIFT): A Dual-Model Framework for Efficient Long-Context Inference (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing solutions to integrate extensive, dynamic knowledge into Large Language Models (LLMs) are constrained by finite context windows, retriever noise, or the risk of catastrophic forgetting. |
| Approach: | They propose a dual-model architecture that explicitly decouples knowledge extraction from the reasoning process by compressing document chunks into implicit fact tokens conditioned on the query. |
| Outcome: | The proposed architecture significantly outperforms strong baselines among comparably sized models on long-context tasks while maintaining inference accuracy. |